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FOREWORD 


In  September  1990,  the  Department  of  Defense  Inspector  General 
(DoDIG)  released  its  final  report  entitled  Audit  of  Nonconforming 
Products  Procured  by  the  Defense  Industrial  Supply  Center.  In 
the  report,  the  DoDIG  indicated  finding  a  high  degree  of  items 
which  did  not  conform  to  design  specifications.  The  DoDIG 
claimed  such  high  rates  were  attributed  to  an  inadequate  Depart¬ 
ment  of  Defense  (DoD)  Quality  Assurance  Program  which  "...  lacked 
the  support  of  a  DoD  policy  that  would  use  laboratory  testing  as 
a  principal  quality  assurance  tool." 

Defense  Logistics  Agency's  (DLA)  Logistics  Management  Division, 
Directorate  of  Quality  Assurance  (DLA-QL)  immediately  initiated 
actions  to  improve  DLA's  Quality  Assurance  Program  by  establish¬ 
ing  a  program  of  laboratory  testing.  However,  to  effectively 
implement  the  program,  statistically  sound  sampling  plans  needed 
to  be  developed.  Such  plans  would  be  used  by  the  Agency  in 
determining  appropriate  sampling  requirements  and  confidence 
levels  of  estimating  material  conformance  levels. 


DLA-QL  requested  analytical  support  from  DLA's  Operations  Re¬ 
search  and  Economic  Analysis  Management  Support  Office  (DLA- 
DORO)  in  developing  the  required  sampling  plans  as  well  as  a 
forecasting  tool  which  would  be  used  in  predicting  the  change  in 
conformance  levels  over  time.  This  report  describes  the  method¬ 
ology  DLA-DORO  used  in  developing  the  sampling  plans  and  fore¬ 
casting  tool.  An  analysis  of  the  prototype  sampling  plans  and 
forecasting  tool  is  also  provided. 
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EXECUTIVE  SUMMARY 


Defense  Logistics  Agency's  (DLA's)  1990  Strategic  Plan  (dated  19 
March,  1990);  Acquisition  Services  Objective  2-1;  Task  (6)  called  for  the 
"use  of  laboratory  testing  to  verify  the  quality  of  spare  and  repair  parts." 
With  that  guidance,  DLA's  Logistics  Management  Division,  Directorate  of 
Quality  Assurance  (DLA-QL)  initiated  an  comprehensive  action  plan  for  turn¬ 
ing  the  above  task  into  an  operational  reality. 

As  an  reinforcing  action,  the  Department  of  Defense  Inspector  General 
(DoDIG) ,  in  September  1990  released  a  report  entitled  Audit  of  NonConforming 
Products  Procured  by  the  Defense  Industrial  Supply  Center  which  highlighted 
the  necessity  of  using  "...  laboratory  testing  as  a  principle  quality  assur¬ 
ance  tool . " 

At  the  core  of  DLA-QL' s  plan  was  the  establishment  of  an  Agency  level 
program  of  laboratory  testing.  To  effectively  implement  the  testing  pro¬ 
gram,  statistically  sound  sampling  procedures  were  needed.  The  task  of 
developing  these  procedures  was  directed  to  DLA's  Operations  Research  and 
Economic  Analysis  Management  Support  Office  (DLA-DQRO)  by  DLA-QL.  This 
report  documents  the  methodology  used  in  developing  the  requested  sampling 
procedures . 

Development  of  these  procedures  involved  a  three  phase  process.  The 
first  phase  involved  developing  simple  random  sampling  plans.  These  plans 
provided  DLA's  four  hardware  centers  a  statistically  sound  approach  for 
estimating  aggregate  nonconformance  levels.  As  part  of  this  phase,  a  user- 
friendly  personal  computer  (PC)  based  model  was  developed.  The  model, 
entitled  Sampling  Assistance  Model  (SAM),  calculates  sample  size  require¬ 
ments  and  confidence  levels  and  identifies  National  Stock  Numbers  (NSNs) 
eligible  for  testing. 

The  second  phase  involved  developing  multi-stage,  stratified  sampling 
plans  for  the  centers.  These  plans  provided  the  centers  a  defensible  ap¬ 
proach  for  estimating  nonconformance  levels  between  DLA's  six  defense  depots 
and  the  five  Defense  Contract  Management  Districts  (DCMDs)  and  the  centers' 
locally  administrated  contracting  office.  A  prototype  model  was  also  de¬ 
veloped  which  automated  the  development  process  of  the  stratified  plans. 

The  final  phase  of  the  study  involved  developing  procedures  for  fore¬ 
casting  the  trend  of  nonconformance  levels.  The  proposed  approach  for  de¬ 
veloping  the  forecasting  tool  was  to  apply  the  exponential  smoothing  adjust¬ 
ed  for  trend  technique.  This  approach  was  selected  because  of  its  ease  of 
use,  minimal  requirement  for  historical  data,  and  predictive  ability  outside 
the  range  of  the  input  data. 

The  above  described  sampling  procedures  have  been  reviewed  by  the  DoDIG 
office  and  were  found  to  be  technically  sound  and  appropriate  for  supporting 
the  DoDIG 's  Audit  recommendation  for  laboratory  testing. 
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I.  INTRODUCTION 


In  its  quest  to  improve  the  quality  of  products  provided  to  the  military 
services,  Defense  Logistics  Agency  (DLA)  embarked  on  a  comprehensive  plan 
for  enhancing  its  Quality  Assurance  Program.  Guidance  for  obtaining  the 
above  goal  was  identified  in  the  Acquisition  Services  Section  of  DLA's 
Strategic  Plan.  Within  this  Plan,  Objective  2  states  "Develop  and  implement 
initiatives  for  continuously  improving  the  quality  of  products  and  services 
delivered  to  our  customers."  Task  6  of  this  Objective  called  for  "use  of 

laboratory  testing  to  verify  the  quality  of  spare  and  repair  parts."  To 

meet  this  task  requirement  DLA's  Logistics  Management  Division,  Directorate 
Quality  Assurance  (DLA-QL)  was  chartered  to  develop  a  thorough  course  of 
action  to  establish  an  Agency  wide  Laboratory  Testing  Program. 

As  an  impetus  for  this  program,  the  Department  of  Defense  Inspector  General 
(DoDIG) ,  in  September  1990,  released  a  report  entitled  Audit  of  Non- 
conforming  Products  Procured  by  the  Defense  Industrirl  Supply  Center  which 

highlighted  the  need  to  "...  use  laboratory  testing  as  a  principle  quality 

assurance  tool . " 

To  effectively  implement  DLA-QL' s  proposed  testing  program,  statistically 
sound  sampling  procedures  were  required.  These  procedures  would  be  used  to 
estimate  product  conformance  levels  among  the  Agency's  supply  centers, 
depots,  and  contract  management  districts.  DLA's  Operations  Research  and 
Economic  Analysis  Management  Support  Office  (DLA-DORO)  was  tasked  ,by  DLA- 
QL,  to  provide  the  required  analytical  support  to  develop  these  procedures. 

II.  PURPOSE 

A.  Develop  a  statistically  defendable  approach  for  determining  sam¬ 
pling  requirements  as  well  as  selecting  candidate  National  Stock  Numbers 
NSNs)  for  DLA's  Laboratory  Testing  Program.  This  effort  involves  the 
development  of  a  sampling  plan. 

B.  Develop  a  forecasting  tool  that  predicts  trends  in  DLA's  noncon¬ 
formity  levels. 

III.  OBJECTIVES 


A.  Develop  statistically  sound  stratified  sampling  plans,  with  ac¬ 
ceptable  confidence  limits,  that  accurately  describes  the  process  for  calcu¬ 
lating  sample  size  requirements  and  selecting  NSNs. 

B.  Provide  a  forecasting  tool  that  uses  historical  laboratory  testing 
data  to  project  future  DLA  conformance  levels. 

C.  Determine  the  feasibility  of  identifying  the  statistical  risk 
associated  with  pooling  random  and  non- random  sampling  data. 

D.  Identify  potential  benefits,  in  terms  of  cost  avoidance/savings, 
by  improving  DLA's  Laboratory  Testing  Program's  sampling  process. 
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IV.  SCOPE 


To  develop  sampling  and  forecasting  procedures  to  be  used  at  DLA's  four 
hardware  centers  (Defense  General  Supply  Center  (DGSC) ,  Defense  Industrial 
Supply  Center  (DISC) ,  Defense  Electronic  Supply  Center  (DESC) ,  and  Defense 
Construction  Supply  Center  (DCSC))  in  support  of  their  laboratory  testing 
efforts. 

Sampling  plans  were  developed  to  obtain  conformity  information  about: 

A.  The  Agency 

B.  The  four  hardware  centers 

C.  The  Defense  Contract  Management  Districts  (DCMDs)  and  the  centers' 
contract  administration  office. 

D.  The  DLA  depots 

E.  Source  versus  destination  inspections 

V.  ASSUMPTIONS 

A.  Calculated  sample  sizes  were  large  enough  to  apply  the  Central 
Limit  Theorem. 

B.  Sample  conformance  levels  were  assumed  not  to  be  0  or  100  percent. 

C.  When  identifying  an  appropriate  forecasting  tool,  it  was  assumed 
that  conformance  levels  did  not  contain  seasonal  or  cyclic  component. 

VI.  LIMITATIONS 


A.  The  study  population  was  limited  to  NSNs  with  technical  data,  nor¬ 
mally  stocked  within  the  depots,  critical  or  essential  to  weapon  systems, 
and  with  procurement  activity  during  the  past  2  years. 

B.  Part  numbered  items  were  not  considered. 

C.  Due  to  an  inadequate  amount  of  randomly  obtained  historical  data, 
only  a  prototype  stratified  sampling  plan  and  forecasting  tool  were  de¬ 
veloped. 


D.  The  sampling  plans  developed  by  this  study  only  identify  NSNs  to 
be  considered  for  testing.  Sampling  plans  for  testing  lots  or  individual 
items  within  the  NSN  are  covered  by  MIL-STD-105E  or  MIL-STD-414. 
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VII.  METHODOLOGY 


A.  Introduction.  After  reviewing  the  study  requirements,  it  was 
determined  the  best  approach  was  to  conduct  the  study  in  three  phases.  The 
first  phase  involved  development  of  simple  random  sampling  plans.  As  part 
of  this  effort,  a  user  friendly,  personal  computer  (PC)  based  model,  enti¬ 
tled  the  Sampling  Assistance  Model  (SAM) ,  was  developed  to  automate  the 
sampling  calculations.  Results  from  this  sampling  efforts  were  also  to  be 
used  as  input  for  the  more  complex,  stratified  sampling  plans.  Development 
of  the  stratified  plans  was  the  second  phase  of  this  study.  This  second 
phase  involved  developing  sampling  procedures  for  estimating  nonconformance 
levels,  at  each  center,  for  both  DLA's  DCMDs  and  depots.  The  final  phase 
involved  identifying  an  appropriate  forecasting  technique  to  predict  trends 
in  conformance  levels. 

B.  Simple  Random  Sampling 

1.  Input  Data  Development 

The  first  step  was  to  define  the  testing  population  and  construct  the  popu¬ 
lation  data  files.  Separate  files  were  developed  for  each  hardware  center. 
The  following  criteria  were  used  to  define  the  population  and  construct  the 
data  files: 


a.  Only  stocked  NSN  items  were  considered  (Duplicate  NSN 
records  were  eliminated) . 

b.  NSNs  had  to  be  associated  with  a  weapon  system  and  identi¬ 
fied  as  being  essential  to  its  operation,  (i.e.,  Essentiality  Coded  (EssC) : 
1,  5,  6,  or  7) .  The  highest  EssC  was  retained. 

c.  NSNs  had  to  be  identified  as  being  critical  to  a  weapon 
system,  (i.e.,  Critical  Item  Code  -  "Y"). 

d.  NSNs  with  procurement  activity  over  the  past  2  years 
(i.e.,  procurement  Julian  dates  between  88365-90365). 

e.  NSNs  with  available  technical  data  (either  design  drawings 
or  specifications/standards) . 

Actual  construction  of  input  data  files  involved  screening  and  matching  NSNs 
based  upon  the  above  criteria.  Figure  1  shows  the  process  used  in  develop¬ 
ing  the  input  data  files.  Files  used  in  this  process  were  obtained  from 
DLA's  Integrated  Data  Bank. 
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2.  Sample  Size  Determination 

Population  proportion  sampling  techniques  were  used  to  determine  appropriate 
sample  size  requirements.  In  using  this  approach,  prior  knowledge  of  the 
proportion  of  the  population  nonconforming  was  useful.  In  cases  where  past 
information  was  not  available,  it  was  assumed  that  50  percent  of  the  popula¬ 
tion  was  nonconforming.  This  approach  did  not  require  knowledge  of  the 
population  size  since  sample  size  determination  was  independent  of  popula¬ 
tion  size  when  using  large  population  simple  sampling  techniques. 


The  equation  used  to  calculate  the  simple  sample  size  value  was: 


zzP(l  -  P) 


n 


where 

P  -  percent  of  the  population  nonconforming 
z  ■=■  standard  normal  deviate 
e  -  precision  level 

This  equation  provided  some  degree  of  flexibility  in  determining  an  accept¬ 
able  sample  size  'n'.  The  two  parameters  which  provide  this  flexibility 
were  the  standard  normal  deviate  ' z'  and  the  precision  level  'e'.  The 
standard  normal  deviate  represented  the  acceptable  level  of  confidence  the 
user  wished  to  obtain  about  how  well  the  sampling  results  accurately  reflect 
the  true  population  nonconformance  level.  Corresponding  z-values  were 
obtained  from  a  Standard  Normal  Distribution  table.  For  example,  a  95 
percent  confidence  level  would  result  in  a  z-value  of  1.96.  In  SAM,  confi¬ 
dence  levels  were  set  at  either  85,  90,  95,  or  99  percent. 

The  precision  level  'e'  referred  to  the  maximum  amount  the  point  estimate 
(derived  from  the  sampling  process)  was  allowed  to  extend  above  and  below 
the  true  population  conformance  level.  In  SAM,  the  user  was  allowed  to 
enter  the  desired  level. 

3 .  Confidence  Level  Determination 


In  cases  where  resource  constraints  limit  the  size  of  sampling,  the  user  may 
want  to  know  the  level  of  confidence  obtained  about  the  sample  results. 
Confidence  levels  were  derived  by  using  the  following  equation: 


1  e2  *  n 


Pd-P) 


Once  the  z-value  was  calculated,  confidence  level  values  were  obtainable  by 
referring  to  a  Standard  Normal  Distribution  Table. 

4.  Random  Selection  of  Eligible  NSNs .  To  insure  that  sampling 
results  were  not  biased,  selection  of  NSNs  occurred  in  a  random  manner. 
Randomly  selecting  items  was  an  important  aspect  of  insuring  representative¬ 
ness  of  the  true  population.  Based  on  statistical  principles,  representa¬ 
tiveness  was  a  major  requirement  for  making  statistically  sound  inferences 
about  the  sampling  population.  Thus,  non-random  testing  results  should  not 
be  used  in  estimating  a  nonconformance  level  when  the  selection  of  the  non- 
random  samples  were  not  representative  of  the  true  population  (i.e.,  using 
non-random  testing  results  from  contractors  with  a  history  of  high  levels 
of  nonconforming  products). 
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Random  selection  of  NSNs  was  accomplished  for  the  Sampling  Assistance  Model 
(SAM)  user  by  utilizing  an  internal  random  number  generator.  The  selection 
process  involved  first  rank  ordering  the  population  NSNs  in  ascending  order 
and  tagging  them  with  a  record  number.  Once  the  population  size  was  inter¬ 
nally  determined,  the  random  number  generator  produced  an  appropriate  list 
of  random  numbers  between  1  and  the  number  of  NSNs  within  the  population. 
The  resulting  list  of  random  numbers  were  then  matched  to  the  appropriate 
NSN  record  number.  Associated  NSN  values  were  then  appended  to  an  output 
listing. 

C.  Stratified  Sampling  Process 

1.  Input  Data  Base  Developed 

Development  of  the  stratified  testing  population  was  based  upon  the  same 
criteria  used  in  the  simple  sampling  approach.  However  in  the  stratified 
case,  duplicate  NSNs  were  listed  if  the  NSN  was  stocked  at  multiple  DLA 
depots,  if  contracts  for  the  NSN  were  administrated  at  multiple  DCMDs,  or 
if  the  NSN  had  multiple  contract  line  numbers.  For  each  NSN  record,  two 
flags  were  set  to  identify  the  stocking  depot  and  contract  administrating 
location.  The  location  categories  were: 

a.  Ey  the  following  six  DLA  Depots: 

(1)  Defense  Depot  Region  East  (DDRE) 

(2)  Defense  Distribution  Region  West  (DDRW) 

(3)  Defense  Depot  Columbus  (DDCO) 

(4)  Defense  Depot  Memphis  (DDMT) 

(5)  Defense  Depot  Richmond  (DDRV) 

(6)  Defense  Depot  Ogden  (DDOU) 

b.  By  the  following  five  DCMDs  and  the  hardware  centers 
locally  administered  program: 

(1)  Local  contract  administration  by  hardware  center 

(2)  Central 

(3)  Northeast 

(4)  Mid  Atlantic 

(5)  South 

(6)  West 
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By  using  these  two  location  flags,  the  population  of  NSN  records  was  able  to 
be  stratified  by  the  two  activity  groups.  The  stratified  process  resulted 
in  the  development  of  a  6  by  6  matrix  (see  Table  1) .  Each  cell  within  the 
matrix  represented  the  number  of  NSN  records  stocked  at  a  specific  depot  and 
administered  by  a  specific  DCMD  or  local  contracting  office. 

Table  1 

DEMOGRAPHICS  OF  ELIGIBLE  NSN  RECORDS  BY  DEPOT  &  DCMD 


By  Frequency  and  Percent 


DCMD 

North  Mid- 

Depot  1  Local  j  Central  |  East  [ Atlantic |  South  [  West 

I  !  Ill  I 

DDRE  |  Nn  |  ||  |  | 

_ „  n  ■  ■  -4-.  .4-..  .,1,.,  ■  »  «  ■  n  ■  .  -t|- _  „  _  _  . 

DDRW  I  N21  |  ||  |  | 

. + . + . + . + . + . + . 

DDCO  I  Nih  |  ||  |  | 

. . +- - -  •  -  -  -  -  •  -  -  -  -+ - 

DDMT  |  |  III  I 

DDRV  |  |  III  I 

- 1 - 1 - 1 - 1 - 1 - 1 - 

DD0U  -  i  „  1  j  I _  I  __  | 

Total  |  2  ^il  2  Ni2  • 


I  I  Total 

II 

I  I  S  N^ 
++ . 


||  2  N 
++ - 


2h 


++ 

II 

++ 

II 

++ 


2  N 


ih 


In  addition  to  the  above  two  flags,  a  third  flag  was  included  in  the  data 
file  to  identify  if  the  NSN  was  inspected  at  the  source  (manufacturers 
location)  or  at  the  destination  (i.e.,  the  depot).  The  contract  and  con¬ 
tract  line  item  numbers  were  also  tagged  for  each  NSN  record. 

2 .  Sample  Size  Determination 

The  approach  used  in  calculating  the  stratified  sample  size  was  more  complex 
than  used  in  the  simple  approach.  In  the  stratified  case,  the  population 
had  to  be  properly  distributed  among  the  various  depots  and  the  contracting 
administration  organizations.  This  was  accomplished  by  incorporating 
demographic  information  of  the  population  into  the  sample  size  calculations. 
Nonconformance  information  about  each  stratum  was  also  required. 

Determination  of  an  overall  optimal  sample  size  involved  two  steps.  The 
first  step  involved  developing  stratified  sample  plans  for  each  depot  and 
contract  administration  location  (i.e.,  developing  a  plan  for  each  row  and 
column  of  the  demographic  matrix) .  These  plans  were  developed  by  using 
proportional  stratified  sampling  techniques.  Refer  to  Appendix  A  for  a  de¬ 
tailed  description  on  how  this  technique  was  applied.  A  total  of  12  plans 
(1  for  each  of  the  6  DLA  depots,  the  5  DCMDs,  and  locally  administered 
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contract  office)  were  constructed.  These  plans  were  organized  into  the 
following  two  groups: 

a.  Six  plans  that  defined  sample  size  requirements  for 
estimating  DCMD  and  the  local  contracting  office  nonconformance  levels. 

b.  Six  plans  that  defined  sample  size  requirements  for  esti¬ 
mating  depot  nonconformance  levels. 

Results  from  each  group  were  then  displayed  in  a  6  by  6  sampling  matrix. 
These  matrixes  became  the  hardware  center's  plan  for  estimating  conformance 
levels  between  either  the  DCMDs  and  local  contracting  office  or  the  depots. 

To  obtain  an  overall  stratified  sampling  plan  for  estimating  nonconformance 
levels  for  both  the  contracting  administration  organizations  and  depots,  a 
composite  matrix  was  constructed.  The  construction  of  this  matrix  became 
the  second  step  in  determining  an  optimal  sample  size.  This  step  involved 
the  use  of  integer  programming  (IP)  techniques  and  the  sampling  requirements 
obtained  from  the  2  stratified  sampling  plans  developed  in  step  1.  IP  was 
used  to  optimize  overall  sampling  requirements  and  accurately  proportion  the 
sampling  requirements  among  each  of  the  cells  within  the  composite  matrix. 
Refer  to  Appendix  B  for  detailed  discussions  on  the  formulation  of  the  IP 
problem. 

D.  Development  of  the  Forecasting  Model 

The  selected  forecasting  technique  used  in  predicting  the  trend  of  non¬ 
conformance  levels  throughout  the  Agency  was  Exponential  Smoothing  Adjusted 
for  Trend.  This  approach  was  selected  because  of  its: 

1.  Ease  in  use. 

2.  Minimal  requirement  for  historic  data. 

3.  Predictive  ability  outside  the  range  of  the  input  data. 

A  detailed  discussion  of  applying  the  exponential  smoothing  technique  to 
sampling  data  is  provided  in  Appendix  C. 

VIII.  ANALYSIS  OF  RESULTS 


A.  Introduction.  Discussions  within  this  section  focus  on  describ¬ 
ing  the  study  population,  capabilities  of  SAM,  and  results  of  testing  the 
prototype  stratified  sampling  plan.  DGSC  data  will  be  used  for  these  dis¬ 
cussions  . 
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B.  Description  of  Eligible  Population 


Based  upon  criteria  used  for  identifying  eligible  NSNs,  a  testing  population 
was  defined.  During  the  screening  process,  it  was  found  the  largest  dis¬ 
criminator  was  the  availability  of  technical  data.  Table  2  displays  the 
percentage  of  NSNs  within  the  Contract  Technical  Data  File  (CTDF)  that  had 
adequate  technical  data.  Further  analysis  of  DLA's  Active  Contract  File 
showed  this  percentage  improved  to  about  45  percent  based  on  the  value  of 
DLA  contracts  over  the  past  2  years. 

Table  2 


Percent  of  Eligible  NSNs  with  Adequate  Technical  Data 
(Based  on  CTDF) 


Hardware  Center 


%  NSNs  %  Dollar  Value 


DGSC 

DESC 

DISC 

DCSC 

DLA  Average 


12.7  57.3 

17.2  41.7 

25.2  49.0 

11.6  33.1 

16.7  45.3 


Table  3  displays  the  eligible  NSN  population  size  when  using  simple  random 
sampling  techniques. 


Table  3 


SIZE  OF  THE  LABORATORY  TESTING  POPULATION 
(Using  Simple  Random  Sampling  Techniques) 


Hardware  Center 


No.  of  NSNs 


Resulting  No.  of  FSC's 


DGSC 

DESC 

DISC 

DCSC 


4,200 

105 

13,065 

39 

17,678 

37 

5.006 

60 

DLA  Totals 


39,949 


241 


Distribution  of  eligible  NSNs  among  the  Federal  Supply  Classes  (FSCs)  are 
presented  in  Figure  2.  The  driving  FSCs  are  easily  identified.  Refer  to 
Appendix  D  for  supporting  data  and  charts  for  the  other  hardware  centers. 
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For  stratified  sampling,  the  demographics  of  the  eligible  population  are 
presented  by  a  6  by  6  matrix  (Table  4) .  The  rows  of  the  matrix  identify 
the  depots  and  the  columns  identify  the  contract  administration  organiza¬ 
tion.  Integer  values  in  each  cell  represent  the  number  of  NSN  records 
stocked  at  a  specific  depot  and  administered  by  a  specific  DCMD  or  center. 
The  decimal  number  within  the  cell  refers  to  the  percentage  of  the  cell's 


Figure  2 


population  as  compared  to  the  overall  population  total.  Figures  in  the  far 
right  column  represent  the  eligible  population  totals  for  each  depot  and  the 
bottom  row  represents  the  eligible  population  of  each  contract  administra¬ 
tion  organization.  The  overall  eligible  population  size  was  identified  in 
the  bottom,  far  right  cell. 
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Table  4 


TEMOGRAPHICS  OF  ELIGIBLE  NSN  RECORDS:  DGSC 


By  Frequency  and  Percent 


DCMD 

North  Mid¬ 


Depot 

Local 

Central 

East 

Atlantic 

South 

He£t 

Total 

DDRE 

778 

103 

202 

355 

90 

125 

1653 

3.62 

0.48 

0.94 

1.65 

0.42 

0.58 

7.69 

DDRU 

1821 

277 

513 

857 

371 

377 

4216 

8.47 

1.29 

2.39 

3.99 

1.73 

1.75 

19.62 

DDCO 

308 

109 

67 

166 

106 

55 

811 

.  1.43 

0.51 

0.31 

0.77 

0.49 

0.26 

3.77 

DDMT 

1722 

296 

499 

1100 

479 

466 

4562 

8.01 

1.38 

2.32 

5.12 

2.23 

2.17 

21.23 

DDRV 

2359 

403 

813 

1489 

643 

594 

6301 

10.98 

1.88 

3.78 

6.93 

2.99 

2.76 

29.32 

DDOU 

1430 

280 

449 

977 

422 

388 

3946 

6.65 

1.30 

2.09 

4.55 

1.96 

1,81 

18,36 

Total 

8418 

1468 

2543 

4944 

2111 

2005 

21489 

39.17 

6.83 

11.83 

23.01 

9.82 

9.33 

100.00 

The  total 

number 

of  NSN  records  that 

makeup  the  hardware 

centers' 

eligible 

population  is  provided  in  Table  5.  Note,  The  population  size  displayed  in 
Table  5  will  be  larger  than  the  population  listed  in  Table  3.  This  occurs 
because  an  NSN  may  be  stocked  at  more  than  one  depot  and/or  its  procurement 
contracts  may  be  administered  by  more  than  one  contract  administration 
organization.  Refer  to  Appendix  E  for  the  demographic  matrixes  for  the 
other  hardware  centers. 
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Table  5 


STRATIFIED  CANDIDATE  POPULATION  SIZE  BY  HARDWARE  CENTER 


Center 


Population  Size 


DGSC 

DESC 

DISC 

DCSC 

DLA  Total 


21,/.lt$ 

39 


2i% , 


129 , 


C .  Use  of  Sampline  Assistance  Model  f  aM). 

SAM  is  an  automated  simple  random  sampling  plan  for  the  centers .  Based  upon 
user  input,  the  model  provides  information  about  appropriate  sample  size 
requirements,  obtainable  levels  of  confidence  for  a  specified  sample  size, 
and  an  appropriate  listing  of  randw  iy  generated  eligible  NSNs.  Figure  3 
displays  the  SAM  screen  for  calculating  sampling  size  requirements .  In  this 
example,  a  nonconformance  level  is  set  at  25  percent,  95  percent  confidence 
level,  and  a  precision  level  of  .05.  The  resulting  sample  size  is  288  NSNs. 

Figure  3 


LAB  TESTING  SAMPLING  ASSISTANCE  MODEL 
SIMPLE  SAMPLE  SIZE 


NONCONFORMING  PERCENT  : 

2 

PRECISION  LEUEL  £+✓-)  : 

CONFIDENCE  LEUEL  : 

85x 

98  x 

SSx 

99x 

SAMPLE  SIZE  :  288 

Hit  G  to  generate  a  Randon  list  of  288  NSNs>  any  other  hey  to  continue. 
ENTER  to  select  ESC  to  quit  FI  for  help  ARROWS  to  noue 


In  addition  to  calculating  a  specific  sample  size,  SAM  also  provides  the 
capability  to  view  a  range  of  sample  sizes  given  various  nonconformance 
rates,  desired  confidence,  and  precision  levels.  An  example  of  this  capa¬ 
bility  is  shown  in  Figure  4.  This  attribute  allows  the  user  to  investigate 
various  sampling  strategies  in  a  very  efficient  manner.  Note,  sample  sizes 
increase  as  nonconformance  or  confidence  levels  increase;  or  as  precision 
levels  tighten. 


i 
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Figure  4 


LAI! 

TESTING 

SAMPLING 

ASSISTANCE 

MODEL 

3AMPLL’  SIZE 

TABLE 

COMFIDEMCE  LEUEL: 

8Sx 

90x 

rwi 

99x 

Nonconf  orn 

iTvecision  Level 

t+S“  3 

mt 

Percent 

lx 

2x 

3x 

4x 

Sx 

6x 

10X 

S X  <95x3 

1825 

456 

203 

114 

73 

51 

10 

10X  <9 ex) 

3457 

864 

384 

216 

138 

96 

35 

15x  <85x3 

4898 

1225 

544 

306 

196 

136 

49 

20x  <80X3 

614? 

1537 

683 

384 

246 

171 

61 

2Sx.  CVS  3 

72E3 

1801 

800 

450 

288 

200 

72 

30x  <7e;  3 

8067 

2017 

P?6 

504 

323 

224 

81 

35x  <65x3 

8740 

21S5 

971 

546 

350 

243 

C7 

40X  <60x3 

9226 

2305 

102-i 

576 

369 

256 

92 

4Sx  <55x3 

9508 

2377 

1856 

594 

380 

264 

95 

58x 

9684 

2401 

1667 

600 

384 

267 

36 

ENTER  to  r 

fi  1  OCt 

KSC 

■to 

qu  It 

FI  for 

lie  Ip 

nilliOUS 

tO  BOVfi 

SAM  also  provides  the  user  with  the  capability  to  determine  confidence 
levels.  In  this  case  the  user  provides  a  sample  size,  nonconformance  rate, 
and  a  desired  precision  level.  As  an  example,  Figure  5  displays  the  re¬ 
sulting  confidence  level  of  75  percent  for  a  sample  size  of  100,  precision 
rate  of  .05,  and  nonconformance  rate  of  25  percent. 

Figure  5 


LAB  TEST  IMG  SAl  nlfiG  ASSISTANCE  MODEL 
COMFIDEMCE  LEUEL 

M0HC0HF0RM  PERCENT  :  25 x 

PRECISION  LEUEL  (+/-)  :  5* 

SAMPLE  SIZE  :  100 

CONFIBiihCE  LEUEL  :  0,750 


EMTER  to  select  ESC  to  quit  FI  for  help  ARROWS  to  noue 


I 
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SAM  also  provides  the  user  confidence  level  tables  to  investigate  various 
sampling  strategies.  This  information  is  useful  when  testing  resources  are 
limited.  Figure  6  displays  a  sample  table  for  a  precision  level  of  +/-  5 
percent.  As  shown  by  this  figure,  confidence  levels  improve  as  sample  sizes 
increase  and  nonconformance  levels  decrease. 

Figure  6 


LAD  TESTING  SAMPLING  ASSISTANCE  MODEL 


CONFIDENCE  LEOEL  Ti  VLE 


Precision 

<♦*-} : 

1* 

2*  3* 

4* 

LSU 

6* 

18* 

Nonconform 

Sample 

Sizes 

Percent 

25 

50 

108 

200 

300 

5-20 

1000 

S*  <95 *1 

0.758 

0.895 

0.978 

0.999 

0.999 

0.999 

0.999 

1 0y  <90*1 

0.593 

0.762 

0.905 

0.982 

0.996 

0.999 

0.999 

IS*  <85*1 

0.516 

0.678 

0.838 

0.952 

8.985 

0.999 

0.999 

20*  <80*1 

8.465 

0.621 

0.789 

0.923 

8.970 

0.995 

0.999 

2S*  <75*1 

8.438 

0.588 

8.7P-.I 

0.897 

0.954 

0.990 

0.999 

30*  <70*1 

0.418 

0 .559 

0 . 7''.4 

0 .876 

0.941 

0.985 

0.999 

35*  <65*1 

0.397 

8.541 

0 .  VAf 

i*.2f>l 

0.931 

0.981 

0.999 

40*  <60*1 

8.398 

0.520 

0.692 

0.850 

0.923 

0.977 

0.999 

4S*  <S5*1 

8.383 

0.522 

0.68C 

0.844 

0.918 

0.976 

0.999 

50* 

0.383 

0.522 

0.681: 

0.841 

0.916 

0.975 

0.999 

EHTER  to  select 

ESC  to  quit. 

FI  C or 

lie  Ip 

ennous 

:  to  m* 

After  determining  an  appropriate  sample  size,  SAM  then  provides  the  user  an 
automated  process  for  randomly  identifying  eligible  NSNs  for  testing.  This 
attribute  reduces  the  chances  of  non-random  selection  of  an  NSN,  thus  reduc¬ 
ing  the  possibilities  of  biasing  sampling  results.  The  use  of  non -random 
sample  results  skew  the  estimate  of  conformance,  thus  -providing  an  inaccu¬ 
rate  picture  of  the  true  nonconformance  level  of  the  population  .  Figure  7 
provides  an  example  of  a  randomly  generated  listing  of  25  eligible  NSNs. 

Figure  7 


LAB  TESTING  SAMPLING  ASSISTANCE  MODEL 


RANDOM  NSN  LIST 


■IT  30081369191 
41300087171-17 
•.■,948007386272 
5940018791936 
S33GK9B232G33 
599S3R9335793 
6105697041251 
»>  15800 19846UU 
6210001159152 
521081  .>010074 
6220007 197086 
62480S2S32421 
6240085388891 
6248807272457 
6240010603099 


ENTER  to  select 


6250802244828 

6250802952735 

6620005538892 

6685009824058 

6850000338051 

68508R2246666 

7240000093027 

91S800S29751U 

9150006574959 

9330804833266 


NIT 


TO  SEND  TO  PRINTER 


ESC  to  HU It 


FI  for  help 


ARROWS  to  niiuu 


D.  Determination  of  Number  of  Test  Specimens.  Once  an  MSN  is  selected 
for  testing,  the  next  step  is  to  determine  the  number  of  test  specimens. 
The  initial  answer  to  this  question  is  one  specimen.  However,  if  testing 
resources  permit,  the  better  approach  is  to  follow  the  sampling  procedures 
in  MIL-STD-105E,  Sampling  Procedures  and  Tables  For  Inspection  bv  At¬ 
tributes  .  or  MIL-STD-4'14,  Sampling  Procedures  and  Tables  For  Inspection  Bv 
Variables  For  Percent  Defective.  If  MIL-STD-105E  procedures  are  used,  it  is 
advisable  to  follow  the  Limiting  Quality  sampling  plans. 

E.  Stratified  Sampling  Approach 

A  prototype  model  has  been  developed  using  Lotus  123  Release  3  to  test  the 
stratified  sampling  plan  methodology  (worksheets  used  in  calculating  the 
results  are  provided  in  Appendix  F) .  Under  a  future  study  effort  a  user- 
friendly,  PC  based  program  will  be  developed  similar  to  SAM.  In  construct¬ 
ing  the  prototype  model  a  confidence  level  of  95  percent  and  precision  level 
of  +/-  .08  are  used.  Proxy  data  is  used  for  historical  sample  size  require¬ 
ments  and  nonconformance  levels . 

Since  the  level  of  sampling  information  is  of  greater  detail  (i.e.,  ob¬ 
taining  conformance  data  about  the  depots  and  DCMDs) ,  overall  sampling 
requirements  are  much  larger  than  simple  random  sampling.  Sampling  re¬ 
quirements  for  individual  cells  within  the  matrix  are  not  of  the  same  pro¬ 
portion  as  in  the  demographics  matrix.  This  occurs  because  of  differences 
in  nonconformance  levels  for  each  cell.  A  higher  historical  rate  (up  to  50 
percent)  of  nonconformance  leads  to  a  higher  sampling  requirement  for  the 
cell. 

The  process  of  developing  an  optimal  stratified  sampling  plan  involves  three 
steps.  The  first  step  involves  developing  the  stratified  sampling  plan  for 
the  DCMDs.  Results  of  that  step  are  shown  in  Table  6.  In  this  example, 
DGSC  is  required  to  conduct  611  tests  to  make  a  statistical  estimate  of  the 
nonconformance  levels  between  the  DCMDs.  The  number  of  samples  needed  from 
each  DCMD  is  shown  in  the  bottom  row.  In  this  case,  one  will  be  95  percent 
confident  that  the  sampling  results  represent  the  true  nonconformance  level 
of  the  eligible  population. 

Results  from  this  plan  can  not  be  used  to  make  statistical  estimates  of 
nonconformance  levels  between  the  depots.  To  make  an  estimate  for  the  de¬ 
pots,  a  second  stratified  sampling  is  required.  In  this  second  step,  a  new 
matrix  is  developed  using  the  same  procedures  as  in  the  first.  Results  of 
this  step  are  provided  in  Table  7. 
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Table  6 


STRATIFIED  SAMPLING  PLAN 

FOR  DETERMINING  DCMD  CONFORMANCE  ESTIMATES  FOR  DGSC 
(Prototype  Model) 

DCMD 


Depot 

Local 

Central 

North 

East 

Mid- 

Atlantic 

South 

West 

Total 

DDRE 

9 

6 

9 

8 

5 

6 

43 

DDRW 

21 

17 

22 

18 

19 

19 

116 

DDCO 

4 

7 

3 

4 

5 

3 

26 

DDMT 

20 

18 

22 

24 

24 

23 

131 

DDRV 

28 

24 

35 

32 

33 

29 

181 

DDOU 

17 

17 

19 

21 

21 

19 

114 

Total 

99 

89 

110 

107 

107 

99 

611 

To  make  estimates  about  nonconformance  levels  at  the  six  depots,  DGSC  will 
have  to  conduct  572  tests.  The  distribution  of  the  depot  tests  is  shown  in 
the  far  right  column  of  the  matrix.  The  difference  between  the  sampling 
requirements  in  Table  6  and  Table  7  is  primarily  attributed  to  different 
nonconformance  rates  and  how  the  population  is  stratified  between  the  two 
plans. 

Table  7 

STRATIFIED  SAMPLING  PLAN 

FOR  DETERMINING  DEPOT  CONFORMANCE  ESTIMATES  FOR  DGSC 
(Prototype  Model) 

DCMD 


Depot 

Local 

Central 

North 

East 

Mid- 

Atlantic 

South 

West 

Total 

DDRE 

46 

6 

12 

21 

5 

7 

97 

DDRW 

44 

7 

13 

21 

9 

9 

103 

DDCO 

39 

14 

8 

21 

13 

7 

102 

DDMT 

32 

5 

9 

20 

9 

9 

84 

DDRV 

36 

6 

12 

23 

10 

9 

96 

DDOU 

33 

_6 

10 

22 

10 

9 

90 

Total 

230 

44 

64 

128 

56 

50 

572 
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To  make  statistical  estimates  about  nonconformance  levels  for  both  depots 
and  DCMDs,  a  third  step  is  required.  Data  from  Table  6  and  Table  7,  as 
well  as  IP  techniques  (see  Appendix  B) ,  are  used  to  calculate  optimal  sam¬ 
pling  requirements. 

Table  8  displays  results  of  the  IP  effort.  As  shown  by  this  table,  656 
laboratory  tests  are  required  to  make  statistical  estimates  of  nonconform¬ 
ance  levels  for  both  DLA's  depots  and  contract  administration  organizations. 
This  figure  is  only  a  7  percent  increase  in  the  number  of  samples  for  the 
DCMDs  and  less  than  13  percent  for  the  depots. 


Table  8 

COMPOSITE  STRATIFIED  SAMPLING  PLAN 
FOR  DETERMINING  DCMD  &  DEPOT  CONFORMANCE  ESTIMATES  FOR  DGSC 

(Prototype  Model) 

DCMD 

North  Mid- 


Depot 

Local 

Central 

East 

Atlantic 

South 

West 

Total 

DDRE 

17 

5 

7 

57 

5 

6 

97 

DDRW 

21 

9 

34 

7 

13 

19 

103 

DDCO 

41 

46 

3 

4 

5 

3 

102 

DDMT 

20 

9 

9 

8 

9 

29 

84 

DDRV 

28 

10 

48 

6 

65 

23 

180 

DDOU 

17 

10 

9 

25 

10 

19 

90 

Total 

144 

89 

110 

107 

107 

99 

656 

Notice  that  stratified  sampling  results  in  much  higher  sampling  requirements 
than  if  simple  random  sampling  techniques  are  used  (refer  to  Figure  4  and 
Table  8) .  The  reason  for  the  higher  stratified  sampling  size  is  the  higher 
level  of  detail  obtained  by  stratifying  the  population  into  two  groups 
(depots  and  contract  administration  locations).  If  a  third  grouping  is 
added,  such  as  stratifying  by  Federal  Supply  Class  (FSC) ,  to  the  present 
stratified  sampling  plans,  sample  size  requirements  will  increase  by  another 
order  of  magnitude. 

F.  Forecasting  Nonconformance  Levels 

Analysis  of  actual  forecasted  nonconformance  levels  was  not  conducted  in 
this  study  due  to  inadequate  historical  data.  However,  an  example  was  pre¬ 
sented  to  demonstrate  how  exponential  smoothing  adjusted  for  trend  would  be 
applied. 
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In  the  example,  past  sampling  at  a  center  resulted  in  nonconformance  levels 
of  42  percent  in  1988,  36  percent  in  1989,  and  31  percent  in  1990.  The 
initial  estimate  of  expected  nonconformance  was  45  percent  and  it  was  esti¬ 
mated  that  nonconformance  levels  would  be  reduced  by  5  percent  a  year 
through  the  use  of  laboratory  testing.  The  smoothing  constants  were  set 
at  .1.  The  resulting  forecasted  levels  for  the  next  3  years  are  shown  in 
Table  9.  Formulas  and  calculations  are  provided  in  Appendix  C. 

Table  9 

Three  Year  Forecast  of  Nonconformance  Levels 


Year 

Nonconformance  Level 

1991 

25.4  % 

1992 

20.5  % 

1993 

15.5  % 

IX.  CONCLUSIONS 

A.  Development  of  the  SAM  provides  the  Agency  with  a  statistically 
sound  approach  for  estimating  nonconformance  of  DLA  items  on  an  aggregate 
center  basis. 

B.  A  major  limiting  factor  in  developing  the  eligible  NSN  population 
is  the  availability  of  technical  data. 

C.  Aggregate  assessments  of  nonconformance  can  be  made  with  relative¬ 
ly  small  sample  sizes.  However,  these  sizes  will  significantly  increase  as 
desired  confidence  and  precision  levels  increase.  Sample  size  requirements 
also  increase  significantly  as  the  level  of  past  nonconformance  increases. 

D.  Sample  size  requirements  significantly  increase  as  the  desired 
level  of  detail  for  information  increases  (i.e.,  going  from  obtaining  non¬ 
conformity  estimates  about  a  center  to  obtaining  estimates  by  center  about 
depots  and  DCMDs) . 

E.  Stratified  sampling  techniques  are  useful  in  estimating  noncon¬ 
formance  levels  within  various  sub-factors  such  as  DLA  organizations. 
However,  the  number  of  groups  are  limited  when  resources  are  considered. 
Sampling  requirements  become  prohibitively  large  as  the  number  of  groups  in¬ 
crease.  A  manageable  number  of  activities  is  two  (DCMDs  and  Depots  in  this 
effort) . 

F.  Use  of  IP  techniques  is  useful  in  significantly  reducing  sample 
sizes  when  combining  stratified  sampling  requirements. 

G.  Exponential  smoothing  adjusted  for  trend  is  useful  in  predicting 
future  nonconformance  levels.  However,  use  of  this  technique  will  first 
require  the  accumulation  of  adequate  historical  random  sampling  results.  At 
least  three  time  periods  of  sampling  data  will  be  required  prior  to  being 
able  to  make  a  prediction  on  nonconformance  trends  throughout  the  Agency. 
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H.  The  use  of  non-random  sampling  results  should  not  be  used  in 
estimating  nonconformance  levels  if  there  is  any  doubt  that  the  non- random 
samples  are  not  representative  of  the  population. 

X.  RECOMMENDATIONS 

A.  The  SAM  should  be  used  in  developing  an  initial  assessment  of  non¬ 
conformity  levels  among  the  hardware  centers.  Randomly  identified  NSNs 
should  be  used  in  selecting  items  for  laboratory  testing.  Non-random  selec¬ 
tion  of  NSNs  will  bias  sampling  results.  Non-random  testing  should  be  used 
to  determine  the  magnitude  of  an  NSN's  (or  contractor)  nonconformance  once  a 
problem  has  been  identified  by  random  testing.  The  non- random  data  should 
not  be  used  in  estimating  nonconformance  levels. 

B.  The  stratified  sampling  plan  should  be  implemented  by  each  hard¬ 
ware  center  in  estimating  nonconformance  levels  between  depots  and  contract 
administration  organizations,  if  funds  are  available  or  if  results  from 
initial  assessment  by  SAM  indicate  an  unacceptable  level  of  nonconformance. 

C.  The  number  of  items  to  be  tested  within  a  selected  NSN  should  be 
determined  in  accordance  with  MIL-STD-105E  or  MIL-STD-414,  if  testing  re¬ 
sources  permit.  Initial  assessments,  using  SAM,  can  be  made  by  testing  one 
item.  If  that  item  is  found  to  be  nonconforming,  additional  non-random 
testing  should  be  conducted  on  the  NSN  and/or  the  vendor  which  supplied  the 
NSN  to  the  government. 

D.  Exponential  smoothing  adjusted  for  trend  should  be  used  throughout 
the  Agency  to  forecast: 

1.  Overall  nonconformance  levels  at  a  center. 

2.  Nonconformance  levels  among  the  DCMDs  and  the  locally  adminis¬ 
tered  contracts. 

3.  Nonconformance  levels  among  the  DLA  depots. 

4.  Nonconformance  levels  between  source  versus  destination  in¬ 
spection. 

E.  A  follow-on  effort  should  be  initiated  to  develop  a  user- 
friendly,  PC-based,  model  that  automates  the  stratified  sampling  plans 
developed  by  this  study.  This  effort  should  include  the  development  of  an 
automated  forecasting  tool  which  incorporates  exponential  smoothing  with 
trend  techniques. 
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XI.  POTENTIAL  BENEFITS .  Development  of  simple  random  and  stratified 
sampling  plans  provide  DLA  a  itistically  defensible  approach  for  estimat¬ 
ing  nonconformance  of  items.  Inis  effort  is  in  direct  support  of  DLA's 
Laboratory  Testing  Program  and  the  DoDIG's  recommendations.  It  is  premature 
at  this  point  to  estimate  the  cost  savings  of  identifying  nonconforming 
items  before  they  enter  the  retail  supply  system.  However,  the  DoDIG  report¬ 
ed  DISC  could  avoid  accepting  about  $250  million  of  non-issuable  products  by 
investing  $10  million  to  $20  million  over  the  next  five  years  for  product 
acceptance  (laboratory)  testing.  Implementation  of  the  sampling  plans  will 
provide  an  enormous  informational  value  to  DLA  in  both  assessing  the  level 
of  item  conformity  throughout  the  Agency  and  as  a  source  for  collecting 
quality  related,  performance  data  about  contractors. 

XII.  DoDIG  REVIEW  OF  METHODOLOGY.  The  methodology  used  in  developing 

the  simple  and  stratified  sampling  plans  described  by  this  report  were  re¬ 
viewed  by  the  DoDIG's  Audit  Office  and  were  found  to  be  technically  sound 
and  appropriate  for  supporting  DoDIG's  recommendation  of  establishing  a 
laboratory  testing  program. 
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APPENDIX  A 


Applying  Stratified  Sampling  Techniques 


A- 1 


Process  of  Calculating  Stratified  Sample  Size  Requirements 

The  process  of  calculating  the  stratified  sample  size  requirements  for  each 
depot  and  DCMD  and  local  contracting  office  involved  using  the  following 
procedures  (actual  application  of  this  technique  is  provided  in  Appendix  F) . 

1.  Determine  the  proportion  of  nonconformance  (P)  at  a  DLA  activity 
(i.e.,  depot  or  DCMD)  by  using  the  following  equations: 

Ph  -  S(  wih  *  ph  ) 


where : 

wih  "  stratum  h  weight 


N 

where : 

-  Total  NSN  Records  in  matrix  cell  (^) 

N  -  Total  size  of  population  (2  Njv) 

and: 

i  -  row  number  (depot) 

h  -  column  number  (Contract  Admin.  Organization) 


and: 


p^  “  nonconformance  rate  for  stratum 


2.  Determine  overall  stratified  sample  size  by  using  the  following 
set  of  equations: 

n'h  -  z2(Pha-Ph» 


The  uncorrected  sample  size  (n')  was  adjusted  to  account  for  the  activity's 
population  size.  The  corrected  sample  size  was  determined  by  the  following 
equation: 


nt,  - 


n' 


1  +  (n'/N) 

3.  Determine  stratum  sample  size  by  using  the  following  equation: 
nih  -  wih  *  nh 


A-2 


4 .  Variance  estimates  were  also  calculated  for  both  the  stratum 
the  overall  sample.  The  equations  used  are  as  follows: 


Stratum  Variance 

ff2ih  =  Ph^-Ph) 
(nih  -  1) 


Overall  Variance 

w2ih  (1  -  fih)  (ph(l  -  ph)) 

o\  =  2  - 


where: 


f ih  “  nih/Nih 


APPENDIX  B 


'pplvipg  Integer  Programming  Technic 
Stratified  Sampling  Plans 
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Formulation  of  the  Integer  Programming  Problem 


I.  Introduction.  Formulation  of  the  IP  problem  Involved  three  steps.  The 
objective  function  was  first  defined  then  the  constraints  were  identified 
and  constructed.  Lastly,  the  optimal  solution  was  determined. 

II.  Formulating  the  Objective  Function 

Since  the  objective  was  to  reduce  overall  sampling  requirements,  the  IP  was 
set  up  as  a  minimization  problem.  Thus,  the  objective  function  was  as 
follows : 


MIN  Z  -  wnxn  +  w21x21  +  .  . .  +  wihxih  +  . . .  +w66x66 
where  the  variable  coefficients  were  defined  as; 
wih  -100*(1  /  (.5  *  wj_)  +  (.5  *  wh)) 
where ; 


-  weight  of  cell  ih  to  the  row  i. 

-  Nih 

J  NiZh 

and 

w^  -  weight  of  cell  ih  to  the  column  h. 


NSih 

and  where  the  function  variables  were  defined  as; 
x^j  -  sample  size  of  cell  ^ 

III .  Formulating  Constraints 

The  above  objective  function  was  then  subject  to  the  row  and  column  con¬ 
straints  of  the  composite  sampling  matrix.  "Right  hand  side"  values  for 
each  constraint  were  obtained  from  the  calculated  sample  size  requirements 
(n^  or  n^)  of  each  of  the  12  sampling  plans.  The  exact  formulation  of  the 
constraints  were: 
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X11  +  x12  +  x13  +  x14  +  x15  +  x16  ~  nlSh 
X21  +  x22  +  x23  +  x24  +  x25  +  x26  ^  n2Sh 
X31  +  x32  +  x33  +  x34  +  x35  +  x36  ^  n3Sh 
X41  +  x42  +  x43  +  x44  +  x45  +  x46  ^  n4Sh 
X51  +  x52  +  x53  +  x54  +  x55  +  x56  -  n5Sh 
X61  +  x62  +  x63  +  x64  +  x65  +  x66  n6Sh 
X11  +  X21  +  X31  +  X41  +  X51  +  Hi  *  nSil 
x12  +  x22  +  x32  +  x42  +  x52  +  x62  -  nSi2 
x13  +  x23  +  x33  +  x43  +  x53  +  x63  -  n2i3 
x14  +  x24  +  x34  +  x44  +  x54  +  x64  ^  nSi4 
x15  +  x25  +  x35  +  x45  +  x55  +  x65  *  n2i5 
x16  +  x26  +  x36  +  x46  +  x56  +  x66  ^  nZi6 

Additional  constraints  were  also  place  on  each  cell  x^-  The  value  for 
these  cell  constraints  was  the  higher  cell  value  from  either  the  depot  or 
the  DCMD  sampling  plan  matrixes. 

IV ,  Solving  the  Integer  Programming  Problem 

DGSC  data  was  used  to  demonstrate  how  to  apply  integer  programming  tech¬ 
niques  to  the  stratified  sampling  data.  The  first  step  was  to  calculate  the 
coefficients  for  the  objective  functions.  The  value  of  the  coefficients  was 
based  upon  the  candidate  NSN  record  demographics  as  shown  in  Table  B-l. 

Table  B-l 

Example  of  Eligible  NSN  Demographics  Matrix:  DGSC 
DCMD 


NORTH¬ 

MID- 

LOCAL 

CENTRAL 

EAST 

ATLANTIC 

SOUTH 

WEST 

* 

TOTAL 

DDRE 

778 

103 

202 

355 

90 

125 

* 

1653 

D 

DDRW 

1821 

277 

513 

857 

371 

377 

* 

4216 

E 

DDCO 

308 

109 

67 

166 

106 

55 

* 

811 

P 

DDMT 

1722 

296 

499 

1100 

.479 

466 

* 

4562 

0 

DDRV 

2359 

403 

813 

1489 

643 

594 

* 

6301 

T 

DDOU 

1430 

280 

499 

977 

422 

388 

* 

•k 

3946 

TOT 

8418 

1468 

2543 

4944 

2111 

2005 

* 

21489 

By  using  the  demographics  information  the  following  equation  was  then  used 
to  calculate  the  coefficient  values. 

CELL  COEF.=100*(1/(.5*(CELL  TOT. /ROW  TOT.)  -»•  .5*(CELL  TOT. /COL.  TOT.)) 

Results  from  these  calculations  are  provided  in  Table  B-2. 
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Table  B-2 


Objective  Function  Coefficients 


DCMD 


LOCAL 

CENTRAL 

NORTHEAST 

Mid- 

ATLANTIC 

SOUTH 

WEST 

DDRE 

355 

1510 

992 

698 

2060 

1450 

DDRW 

309 

786 

618 

531 

758 

721 

DDCO 

480 

959 

1836 

839 

1105 

2100 

DDMT 

344 

750 

654 

431 

603 

598 

DDRV 

306 

591 

446 

372 

492 

512 

DD0U 

376 

764 

689 

449 

652 

685 

Once  the  coefficients  were  defined,  the  formulation  of  the  integer  progrnm- 
ming  problem  was  possible.  The  formulation  of  integer  programming  problem 
for  DGSC's  optimal  stratified  sampling  plan  follows.  A  similar  approach 
would  be  used  in  developing  stratified  sampling  plans  for  the  other  hardware 
centers . 


MIN  355  Xll  +  309  X21  +  480  X31  +  344  X41  +  306  X51  +  376  X61  + 

1510  X12  +  786  X22  +  959  X32  +  750  X42  +  591  X52  +  764  X62  + 

992  X13  +  618  X23  +  1836  X33  +  654  X43  +  446  X53  +  689  X63. + 

698  X14  +  531  X24  +  839  X34  +  431  X44  +  372  X54  +  449  X64  + 

2060  X15  +  758  X25  +  1105  X35  +  603  X45  +  492  X55  +  652  X65  + 

1450  X16  +  721  X26  +  2100  X36  +  598  X46  +  512  X56  +  685  X66 


Constraints : 


SUBJECT  TO 

Xll  +  X21  +  X31 
X12  +  X22  +  X32 
X13  +  X23  +  X33 
X14  +  X24  +  X34 
XI 5  +  X25  +  X35 
X16  +  X26  +  X36 
Xll  +  X12  +  X13 
X21  +  X22  +  X23 
X31  +  X32  +  X33 
X41  +  X42  +  X43 
X51  +  X52  +  X53 
X61  +  X62  +  X63 
Xll  >  9 
X21  >  21 
X31  >  4 
X41  >  20 
X51  >  28 


+  X41  +  X51  +  X61  >  99 
+  X42  +  X52  +  X62  >  89 
+  X43  +  X53  +  X63  >  110 
+  X44  +  X54  +  X64  >  107 
+  X45  +  X55  +  X65  >  107 
+  X46  +  X56  +  X66  >  99 
+  X14  +  X15  +  X16  >  97 
+  X24  +  X25  +  X26  >  103 
+  X34  +  X35  +  X36  >  102 
+  X44  +  X45  +  X46  >  84 
+  X54  +  X55  +  X56  >  96 
+  X64  +  X65  +  X66  >  90 
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Constraints  continued 
X61  >  17 
X12  >  6 
X22  >  7 
X32  >  7 
X42  >  5 
X52  >  6 
X62  >  6 
X13  >  9 
X23  >  13 
X33  >  3 
X43  >  9 
X53  >  12 
X63  >  10 
X14  >  8 
X24  >  18 
X34  >  4 
X44  >  20 
X54  >  23 
X64  >  21 
XI 5  >  5 
X25  >  9 
X35  >  5 
X45  >  9 
X55  >  10 
X65  >  10 
X16  >  6 
X26  >  9 
X36  >  3 
X46  >  9 
X56  >  9 
X66  >  9 

In  solving  for  an  optimal  feasible  solution  a  PC-based,  linear  programming 
package  was  used.  Results  of  cnat  effort  are  provided  in  Table  3-3  Table 
B-4  displays  how  the  optimal  solution  was  applied  to  the  final  composite 
sampling  matrix.  By  summing  the  rows  and  columns  sampling  requirements  were 
then  identified  for  each  depot,  DCMD,  and  the  center's  contract  administra¬ 
tion  office. 
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Table  B-3 


Optimal  Feasible  Solution 
of  Integer  Programming  Problem 


Variable  Name 


Solution 


Variable  Name 


Solution 


Xll 

17 

1 

X14 

57 

X21 

21 

1 

X24 

7 

X31 

41 

1 

X34 

4 

X41 

20 

1 

X44 

8 

X51 

28 

1 

X54 

6 

X61 

17 

1 

X64 

24 

X12 

5 

1 

X15 

5 

X22 

9 

1 

X25 

13 

X32 

46 

1 

X35 

5 

X42 

9 

1 

X45 

9 

X52 

10 

1 

X55 

65 

X62 

10 

1 

X65 

10 

X13 

7 

1 

X16 

6 

X23 

34 

1 

X26 

19 

X33 

3 

1 

X36 

3 

X43 

9 

1 

X46 

29 

X53 

48 

1 

X56 

23 

X63 

9 

1 

X66 

19 

Table  B-4 


STRATIFIED  SAMPLING  PLAN 

FOR  DETERMINING  DCMD  &  DEPOT  NONCONFORMANCE  ESTIMATES  FOR  DGSC 

(Prototype  Model) 

DCMD 


Depot 

Local 

Central 

North 

East 

Mid- 

Atlantic 

South 

West 

Total 

DDRE 

17 

5 

7 

57 

5 

6 

97 

DDRW 

21 

9 

34 

7 

13 

19 

103 

DDCO 

41 

46 

3 

4 

5 

3 

102 

DDMT 

20 

9 

9 

8 

9 

29 

84 

DDRV 

28 

10 

48 

6 

65 

23 

180 

DDOU 

17 

10 

9 

25 

10 

19 

90 

Total 

144 

89 

110 

107 

107 

99 

656 
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APPENDIX  C 


Forecasting  Nonconformance  Levels  bv 


Applvine Exponential  Smoothing  Adiusted  For  Trend 


I.  Exponential  Smoothing  Adjusted  for  Trend  Equations 


The  equation  for  exponential  smoothing  adjusted  for  trend  was 
XtfT  =  ECXj.)  -h  (T*E(St)) 


where: 


value 


T  =  number  of  periods  in  the  future  of  predictive 


t  =  current  period 
and  where 


E(Xt)  «  cue,.  +  (1  -  cc)  CECX(t_1} )  *  E^.t] 
where: 

E(X*.)  =  estimated  value  of  nonconformity  of  the  most 
recent  period  of  sampling  data 

a  =  smoothing  constant  (where  value  should  not 
exceed  .3  and  the  reasonable  choice  was  .1) 

x.u  =  observed  nonconformity  level  obtained  from  sam¬ 
pling  in  period  t. 

E(Xt-1)  =  estimated  value  of  nonconformity  for  the  previous 
period. 


E(St)  =  estimated  trend  rate  which  is  obtained  by: 

=  /?[E(Xt)  -  E(Xt_x)]  +  (1-/?)  EfS^) 
where: 

p  =  smoothing  constraint  for  the  trend  (where  .  1 
would  be  reasonable  choice  value) 

To  apply  the  technique,  at  least  three  periods  of  historical  data 
should  be  used.  Both  the  smoothing  constraints  (a  ana  p)  need  to 
be  reviewed  after  analyzing  several  periods  of  forecasted  data  to 
see  how  well  the  forecasted  values  predicted  the  observed  noncon¬ 
formity  rates. 

II.  An  Example  of  Applying  Exponential  Smoothing  to  Laboratory 
Testing 


As  an  example,  past  sampling  at  a  center  resulted  in  nonconform¬ 
ance  levels  of  42  percent  in  1983,  36  percent  in  1989,  and  31 
percent  in  1990.  The  initial  estimate  of  expected  nonconformance 
was  45  percent  and  it  was  estimated  that  nonconformance  levels 
would  be  reduced  by  5  percent  a  year  through  the  use  of  laboratory 
testing  efforts.  The  smoothing  constraints  c  and  p  were  set 
at  .1.  The  initial  estimate  of  the  expected  nonconformance  level 
and  trend  for  1988  was: 


r_o 


E(X1988>  “  -1(42)  +  -9<45  ‘  5>  “  40 • 2 
The  initial  estimate  of  nonconformance  was  used  to  update  the  trend 

x(sl988)  -  .1(40.2  -  45)  -  .9(5)  -  -4.98 
Repeating  the  process  for  1989  resulted  in: 
the  expected  nonconformance  level  of: 

e(x1989)  -  .1(36)  +  .9(40.2  -  4.98)  -  35.298 
and  trend  value  of: 

E(S1989>  ~  .1(35.298  -  40.2)  -  .9(4.98)  -  -4.97 

For  1990: 

the  expected  nonconformance  level  was: 

E(X1990>  “  -1(31>  +  -9(35-298  -  4.97)  "  30.395 
and  trend  value  of: 

E(S1990)  “  -1(30.395  -  35.298)  -  .9(4.97)  -  -4.96 
Thus,  the  forecasted  nonconformance  level  for: 

1991  would  be: 

30.395  -  1(4.97)  -  25.4  percent 

1992  would  be  : 

30.395  -  2(4.97)  -  20.5  percent 
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APPENDIX  D 


NSN  Distribution  by  FSC  Daca 


D-l 


Figure  D-l 

LAB  TESTING  SAMPLING:  DGSC 

FREQ.  DIST.  OF  SELECTED  NSNS  BY  FSC 


D-2 
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Table  D-l 

DLA's  Laboratory  Testing  Program 
Eligible  NSN  Frequency  Count  By  Federal  Supply  Class  (FSC) :  DGSC 


FSC 

NSN  COUNT 

FSC  NSN 

COUNT 

FSC  NSN  COUNT 

5970 

375 

4933 

10 

3615 

1 

6240 

374 

1680 

9 

3610 

1 

5940 

362 

6675 

9 

3510 

1 

5995 

312 

9350 

8 

7110 

1 

6210 

206 

6635 

8 

8130 

1 

9150 

198 

6120 

8 

8140 

1 

6150 

192 

3441 

6 

3210 

1 

5975 

179 

8125 

6 

6340 

1 

5355 

168 

5220 

5 

6615 

1 

6685 

163 

7320 

5 

6940 

1 

9320 

114 

8110 

5 

3680 

1 

6810 

96 

6130 

5 

3465 

1 

9330 

94 

6695 

5 

2030 

1 

6220 

93 

8120 

5 

3439 

88 

6605 

5 

TOTAL 

4,200 

6850 

79 

6610 

5 

3455 

73 

6260 

4 

4130 

71 

3433 

4 

4140 

70 

6650 

4 

9390 

63 

1090 

4 

6140 

53 

3990 

3 

6680 

50 

3456 

3 

7690 

47 

7340 

3 

6230 

41 

6660 

3 

4240 

35 

3530 

3 

5977 

35 

7240 

3 

1560 

32 

3920 

3 

6105 

32 

3415 

2 

6110 

29 

6760 

2 

6250 

26 

6730 

2 

2040 

25 

6125 

2 

3460 

24 

1670 

2 

6645 

22 

6840 

2 

6670 

21 

3413 

2 

6350 

19 

6720 

1 

1055 

18 

6750 

1 

6115 

17 

6820 

1 

2090 

16 

3444 

Jb 

6135 

15 

3431 

1 

9340 

15 

7105 

1 

3940 

14 

6320 

1 

4920 

14 

4925 

1 

6620 

14 

7310 

1 

6665 

13 

1045 

1 

9160 

13 

4110 

1 

6920 

10 

7360 

1 
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Figure  D-2 

LAB  TESTING  SAMPLING:  DESC 

FREQ.  DIST.  OF  SELECTED  NSNS  BY  FSC 
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Table  D-2 

DLA's  Laboratory  Testing  Program 
Eligible  NSN  Frequency  Count  By  Federal  Supply  Class  (FSC) :  DESC 


FSC 

NSN  COUNT 

5935 

3917 

5905 

2794 

5910 

1202 

5961 

1014 

5930 

907 

5962 

599 

5945 

388 

■5925 

353 

5920 

343 

5950 

242 

5999 

205 

5915 

194 

5985 

140 

6625 

139 

5960 

136 

5955 

94 

5965 

78 

5963 

78 

5990 

58 

5998 

23 

1440 

23 

5855 

18 

5980 

17 

1430 

16 

5815 

15 

5820 

13 

1240 

12 

5805 

11 

4935 

10 

5895 

5 

1260 

5 

5835 

4 

1290 

3 

5821 

2 

1420 

2 

5831 

2 

5850 

1 

5841 

1 

5840 

1 

TOTAL 

13,065 
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Figure  D-3 

TESTING  SAMPLING:  DISC 

DIST.  OF  SELECTED  NSNS  BY  FSC 
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Table  D-3 

DLA's  Laboratory  Testing  Program 
Eligible  NSN  Frequency  Count  By  Federal  Supply  Class  (FSC):  DISC 


FSC 

NSN  COUNT 

5305 

2646 

5330 

2455 

5306 

2271 

5310 

2032 

5340 

1516 

3110 

977 

5365 

934 

5320 

900 

6145 

802 

3120 

725 

5315 

691 

9535 

247 

5360 

220 

4010 

199 

4030 

174 

5307 

163 

5325 

145 

9515 

136 

9540 

95 

9530 

75 

4020 

66 

9510 

62 

9505 

37 

2840 

35 

9520 

18 

9525 

16 

3130 

14 

2915 

8 

5335 

6 

2995 

3 

9630 

3 

2835 

2 

2925 

1 

2935 

1 

2945 

1 

9620 

1 

9640 

1 

TOTAL 

17,678 
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Figure  D-4 

TESTING  SAMPLING:  PCSC 

DIST.  OF  SELECTED  NSNS  BY  FSC 
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Table  D-4 

DLA's  Laboratory  Testing  Program 
Eligible  NSN  Frequency  Count  By  Federal  Supply  Class  (FSC) :  DCSC 


FSC 

NSN  COUNT 

FSC 

NSN  COUNT 

4730 

2058 

4610 

4 

4720 

668 

5410 

4 

4710 

422 

5440 

3 

4820 

392 

4310 

2 

3020 

168 

1010 

2 

3040 

141 

1450 

2 

3030 

128 

2825 

1 

2530 

116 

1095 

1 

4210 

57 

1020 

1 

2520 

57 

3910 

1 

2540 

55 

4420 

1 

1730 

53 

3930 

1 

4320 

52 

2250 

1 

2590 

51 

5430 

1 

2510 

50 

4620 

1 

4220 

46 

2910 

41 

TOTAL 

5,006 

1650 

40 

2990 

34 

4330 

33 

4510 

30 

3010 

28 

2920 

19 

4810 

19 

* 

1005 

18 

1025 

18 

4930 

17 

2940 

15 

4530 

14 

1015 

14 

4520 

14 

2930 

13 

4440 

12 

2805 

11 

3950 

10 

4910 

9 

28 1 ') 

9 

2010 

8 

4940 

6 

1615 

6 

4410 

6 

5420 

6 

4460 

6 

1620 

5 

4540 

5 
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Table  E-l 


Candidate  NSN  Records  Demographics  for  DGSC 


By  Frequency  and  Percent 


DCMD 


Depot 

Local 

Central 

North 

East 

Mj.d- 

Atlar.tic 

South 

West 

Total 

DDRE 

778 

103 

202 

355 

90 

125 

1653 

3.62 

0.48 

0.94 

1.65 

0.42 

0.58 

7.69 

DDRW 

1821 

277 

513 

857 

371 

377 

4216 

8.47 

1.29 

2.39 

3.99 

1.73 

1.75 

19.62 

DDCO 

308 

109 

67 

166 

106 

55 

811 

1.43 

0.51 

0.31 

0.77 

0.49 

0.26 

3.77 

DDMT 

1722 

296 

499 

1100 

479 

466 

4562 

8.01 

1.38 

2.32 

5.12 

2.23 

2.17 

21.23 

DDRV 

2359 

403 

813 

1489 

643 

594 

6301 

10.98 

1.88 

3.78 

6.93 

2.99 

2.76 

29.32 

DDOU 

1430 

280 

449 

977 

422 

388 

3946 

6.65 

1.30 

2,09 

4.55 

1.96 

1,81 

18.36 

Total 

8418 

1468 

2543 

4944 

2111 

2005 

21489 

39.17 

6.83 

11.83 

23.01 

9.82 

9.33 

100.00 
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Table  E-2 


Candidate  NSN  Records  Demographics  for  DESC 


By  Frequency  and  Percent 


DCMD 


North 

Mid- 

Depot 

Local 

Central 

East 

Atlantic 

South 

West 

Total 

DDRE 

5425 

327 

784 

1409 

177 

588 

8710 

13.73 

0.83 

1.98 

3.57 

0.45 

1.49 

22.04 

DDRW 

2446 

192 

512 

780 

88 

320 

4338 

6.19 

0.49 

1.30 

1.97 

0.22 

0.81 

10.98 

DDCO 

1 

0 

1 

1 

0 

0 

3 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.01 

DDMT 

1 

8 

15 

2 

1 

1 

28 

0.00 

0.02 

0.04 

0.01 

0.00 

0.00 

0.07 

DDRV 

9645 

431 

1724 

2333 

181 

819 

15133 

24.41 

1.09 

4.36 

5.90 

0.46 

2.07 

38.29 

DDOU 

7236 

324 

1161 

1800 

144 

643 

11308 

18.31 

0.82 

2.94 

4.55 

0.36 

1.63 

28.61 

Total 

24754 

1282 

4197 

6325 

591 

2371 

39520 

62.64 

3.24 

10.62 

16.00 

1.50 

6.00 

100.00 
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Table  E-3 


Candidate  NSN  Records  Demographics  for  DISC 


By  Frequency  and  Percent 


Denot 

Local 

DDRE 

1509 

3.41 

DDRW 

1751 

3.95 

DDCO 

3023 

6.83 

DDMT 

2981 

6.73 

DDRV 

242 

0.55 

DDOU 

2221 

5.01 

Total 

11727 

26.48 

Central 

North 

East 

157 

939 

0.35 

2.12 

177 

1010 

0.40 

2.28 

340 

797 

0.77 

1.80 

335 

1188 

0.76 

2.68 

25 

96 

0.06 

0.22 

237 

755 

0.54 

1.70 

1271 

4785 

2.87 

10.80 

DCMD 


Mid- 

Atlantic 

South 

1749 

3.95 

661 

1.49 

2017 

4.55 

786 

1.77 

2337 

5.28 

2289 

5.17 

2471 

5.58 

1183 

2.67 

357 

0.81 

161 

0.36 

2154 

4.86 

1896 

4.28 

11085 

25.03 

6976 

15.75 

West 

Total 

1000 

2.26 

6015 

13.58 

1124 

2.54 

6865 

15.50 

2621 

5.92 

11407 

25.76 

1389 

3.14 

9547 

21.56 

144 

0.33 

1025 

2.31 

2166 

4.89 

9429 

21.29 

8444 

19.07 

44288 

100.00 
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Table  E-4 


Candidate  NSN  Records  Demographics  for  DCSC 


By  Frequency  and  Percent 


Depot 

Local 

DDRE 

325 

1.32 

DDRW 

396 

1.61 

DDCO 

403 

1.64 

DDMT 

525 

2.13 

DDRV 

353 

1.43 

DDOU 

448 

1.82 

Total 

2450 

9.95 

Central 

North 

East 

349 

1.42 

299 

1.21 

553 

2.24 

473 

1.92 

533 

2.16 

353 

1.43 

748 

3.04 

449 

1.82 

530 

2.15 

496 

2.01 

609 

2.47 

418 

1.70 

3322 

13.48 

2488 

10.10 

DCMD 


Mid- 

Atlantic 

South 

875 

3.55 

480 

1.95 

1242 

5.04 

605 

2.46 

1123 

4.56 

563 

2.29 

1438 

5.84 

820 

3.33 

1174 

4.77 

489 

1.98 

1317 

2.76 

680 

2.76 

7169 

29.10 

3637 

14.76 

West 

Total 

801 

3.25 

3129 

12.70 

866 

3.52 

4135 

16.79 

787 

3.19 

3762 

15.27 

1388 

5.63 

5368 

21.79 

713 

2.89 

3755 

15.24 

1014 

4.12 

4486 

18.21 

5569 

22.61 

24635 

100.00 
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Table  P-1 


Stratified  Sampling  Matrix:  PGSG 
(Sampling  for  DCMDs) 

CONFIDENCE  LEVEL:  95% 

PRECISION  LEVEL  :  0.08 

DCMD's 

North  Mid- 


Depot 

Local 

Central 

east 

Atlantic 

South 

West 

Total 

DDRE 

9 

6 

9 

8 

5 

6 

43 

DDRW 

21 

17 

22 

18 

19 

19 

116 

DDCO 

4 

7 

3 

4 

5 

3 

26 

DDMT 

20 

18 

22 

24 

24 

23 

131 

DDRV 

28 

24 

35 

32 

33 

29 

181 

DDOU 

12 

12 

12 

21 

21 

12 

114 

Total 

99 

89 

110 

107 

107 

99 

611 

Table  F-2 

Stratified  Sampling  Matrix:  DGSC 

(Sampling  for  Depots) 

CONFIDENCE  LEVEL:  95% 
PRECISION  LEVEL  :  0.08 

Hepot 

Local 

Central 

DCMD's 

North  Mid¬ 

east  Atlantic 

South 

West 

Total 

D’-RE 

46 

6 

12 

21 

5 

7 

97 

DDRW 

44 

7 

13 

21 

9 

9 

103 

DDCO 

39 

14 

8 

21 

13 

7 

102 

DD.HT 

32 

5 

9 

20 

9 

9 

84 

DDRV 

36 

6 

12 

23 

10 

9 

96 

DDOU 

33 

_6 

10 

22 

10 

_9 

90 

Total 

230 

44 

64 

128 

56 

50 

572 
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TABLE  F-3 


STRATIFIED  SAMPLING  PLAN:  LOCALLY  ADMINISTERED  CONTRACTS:  DGSC 
SAMPLE 


STRATUM 

SAMPLE 

NUMBER  PROPORT. 

UEIGHT 

EST  OF 

DEPOT 

NUMBER 

SIZE 

NON-CONF  <p> 

<w) 

VAR.  <cr*5 

(1-f) 

w2  VAR  CAL  w*p 

DDRE 

778 

5 

2  0.4000 

0.0924 

0.0600 

0.9936 

0.0085  0.000509  0.036968 

DDRU 

1821 

10 

3  0.3000 

0.2163 

0.0233 

0.9945 

0.0468  0.001086  0.064897 

DO  CO 

308 

10 

1  0.1000 

0.0366 

0.0100 

0.9675 

0.0013  0.000013  0.003659 

DDMT 

1722 

10 

2  0.2000 

0.2046 

0.0178 

0.9942 

0.0418  0.000740  0.040912 

DDRV 

2359 

9 

1  0.1111 

0.2802 

0.0123 

0.9962 

0.0785  0.000966  0.031137 

DDOU 

1430 

5 

1  0.2000 

0.1699 

0.0400 

0.9965 

0.0289  0.001150  0.033975 

8418 

49 

10 

1.0000 

0.004464  0.211548 

SAMPLE  EST  OF  VAR: 

0.0045 

DISTRIBUTION  OF  SAMPLES 

STANDARD  ERROR: 

0.0668 

SAMPLE  AVE 

• 

0.2115 

DDRE 

9 

DDRU 

21 

MINIMUM  SAHPLE  SIZE 

DOCO 

4 

- 

DDMT 

20- 

PREC  LEVL 

0.08 

DDRV 

28 

CONF  LEVE 

1.96 

DDOU 

17 

N': 

100 

--- 

n: 

99 

99 

TABLE  F-4 

STRATIFIED  SAMPLING  PLAN:  DCMC  CENTRAL 
SAMPLE 


STRATUM 

SAMPLE 

NUMBER  PROPORT. 

UEIGHT 

EST  OF 

DEPOT 

NUMBER 

SIZE 

NON-CONF  (p) 

<H) 

VAR.  (c r‘) 

(1-f) 

m2  VAR  CAL  w*p 

DDRE 

103 

5 

0  0.0000 

0.0702 

0.0000 

0.9515 

0.0049  0.000000  0 

DDRU 

277 

6 

1  0.1667 

0.1887 

0.0278 

0.9783 

0.0356  0.000968  0.031449 

DDCO 

109 

8 

2  0.2500 

0.0743 

0.0268 

0.9266 

0.0055  0.000137  0.018563 

DDMT 

296 

8 

1  0.1250 

0.2016 

0.0156 

0.9730 

0.0407  0.000618  0.025204 

DDRV 

403 

10 

3  0.3000 

0.2745 

0.0233 

0.9752 

0.0754  0.001715  0.082357 

DDOU 

280 

5 

1  0.2000 

0.1907 

0.0400 

0.9821 

0.0364  0.001429  0.038147 

1468 

42 

8 

1.0000 

0.004867  0.195720 

SAHPLE  EST  OF  VAR: 

0.0049 

DISTRIBUTION  OF  SAMPLES 

STANDARD  ERROR: 

0.0698 

— 

SAHPLE  AVE 

: 

0.1957 

DDRE 

6 

DDRU 

17 

MINIMUM  SAHPLE  SIZE 

DDCO 

7 

- 

DDMT 

18 

PREC  LEVL 

0.08 

DDRV 

24 

CONF  LEVE 

1.96 

DDOU 

17 

H': 

94 

— 

n: 

88 

89 

F-3 


TABLE  F-5 


STRATIFIED  SAMPLING  PUN:  DCHC  NORTHEAST 
SAMPLE 


STRATUM 

SAMPLE 

NUMBER  PROPORT. 

WEIGHT 

EST  OF 

DEPOT 

NUMBER 

SIZE 

HOM-CONF  (p) 

(u) 

VAR.  (o-b 

(1-f) 

w2  VAR  CAL  w*p 

OORE 

202 

5 

1  0.2000 

0.0794 

0.0400 

0.9752 

0.0063  0.000246  0.015887 

OORW 

513 

6 

2  0.3333 

0.2017 

0.0444 

0.9883 

0.0407  0.001788  0.067243 

DDCO 

67 

8 

3  0.3750 

0.0263 

0.0335 

0.8806 

0.0007  0.000020  0.00988 

ODHT 

499 

11 

2  0.1818 

0.1962 

0.0149 

0.9780 

0.0385  0.000560  0.035677 

DDRV 

813 

10 

3  0.3000 

0.3197 

0.0233 

0.9877 

0.1022  0.002356  0.09591 

DDtXJ 

449 

5 

1  0.2000 

0.1766 

0.0400 

0.9889 

0.0312  0.001233  0.035313 

2543 

45 

12 

1.0000 

0.006203  0.259910 

SAMPLE  EST  OF  VAR: 

0.0062 

DISTRIBUTION  OF  SAMPLES 

STANDARD  ERROR: 

0.0788 

... 

SAMPLE  AVE 

• 

0.2599 

DDRE 

9 

DDP.W 

22 

MINIMUM  SAMPLE  SIZE 

DDCO 

3 

- 

DDMT 

22 

PREC  LEVL 

0.08 

ODRV 

35 

CONF  LEVE 

1.96 

DDOU 

19 

N': 

115 

— 

n: 

110 

110 

TABLE  F-6 

STRATIFIED  SAMPLING  PLAN:  OCMC  MID-ATLANTIC 
SAMPLE 


STRATUM 

SAMPLE 

NUMBER  PROPORT. 

WEIGHT 

EST  OF 

DEPOT 

NUMBER 

SIZE 

NON-CONF  <p) 

00 

VAR.  <ff‘> 

(1-f) 

w2  VAR  CAL  w*p 

OORE 

355 

5 

2  0.4000 

0.0718 

0.0600 

0.9859 

0.0052  0.000305  0.028722 

DDRU 

857 

7 

2  0.2857 

0.1733 

0.0340 

0.9918 

0.0300  0.001014  0.049526 

DDCO 

166 

a 

2  0.2500 

0.0336 

0.0268 

0.9518 

0.0011  0.000029  0.008394 

ODMT 

1100 

10 

1  0.1000 

0.2225 

0.0100 

0.9909 

0.0495  0.000491  0.022249 

DDRV 

1489 

10 

2  0.2000 

0.3012 

0.0178 

0.9933 

0.0907  0.001602  0.060235 

DDOU 

9  77 

3 

1  0.3333 

0.1976 

0.1111 

0.9969 

0.0391  0.004326  0.065871 

4944 

43 

10 

1.0000 

0.007765  0.234997 

SAMPLE  EST  OF  VAR: 

0.0078 

DISTRIBUTION  OF  SAMPLES 

STANDARO  ERROR: 

0.0881 

— 

SAMPLE  AVE 

J 

0.2350 

DORE 

8 

ODRW 

18 

MINIMUM  SAMPLE  SIZE 

DDCO 

4 

- 

ODMT 

24 

PREC  LEVL 

0.08 

DDRV 

32 

CONF  LEVE 

1.96 

DDOU 

21 

H': 

108 

— 

n: 

106 

107 

F-6 


TABLE  F-7 


STRATIFIED  SAMPLING  PLAN:  DCMC  SOUTH 
SAMPLE 


DEPOT 

STRATUM 

NUMBER 

SAMPLE 

SIZE 

NUM8ER  PROPORT. 
NOH-CONF  <p) 

HEIGHT 

<W) 

EST  OF 
VAR.  CO 

(1-f) 

w2  VAR  CAL  w*p 

DDRE 

90 

5 

1  0.2000 

0.0426 

0.0400 

0.9444 

0.0018  0.000069  0.000527 

DDRU 

371 

6 

2  0.3333 

0.1757 

0.0444 

0.9838 

0.0309  0.001351  0.058582 

DDCO 

106 

8 

3  0.3750 

0.0502 

0.0335 

0.9245 

0.0025  0.000078  0.01883 

DDMT 

479 

10 

1  0.1000 

0.2269 

0.0100 

0.9791 

0.0515  0.000504  0.022691 

DDRV 

643 

9 

3  0.3333 

0.3046 

0.0278 

0.9860 

0.0928  0.002541  0.101532 

DDOU 

422 

5 

1  0.2000 

0.1999 

0.0400 

0.9882 

0.0400  0.001580  0.039981 

2111 

43 

11 

1.0000 

0.006122  0.250142 

SAMPLE  EST  OF  VAR: 

0.0061 

DISTRIBUTION  OF  SAMPLES 

STANDARD  ERROR: 

0.0782 

... 

SAMPLE  AVE 

• 

0.2501 

DDRE 

5 

DDRU 

19 

HINiHUM  SAMPLE  SIZE 

DDCO 

5 

- 

DDMT 

24 

PREC  LEVL 

0.08 

DDRV 

33 

COHF  LEVE 

1.96 

DDOU 

21 

H': 

113 

... 

n: 

107 

107 

TABLE  F-8 

STRATIFIED  SAMPLING  PLAN:  DCMC  UEST 
SAMPLE 


DEPOT 

STRATUM 

NUMBER 

SAMPLE 

SIZE 

NUMBER  PROPORT. 
NON-CONF  (p) 

HEIGHT 

M 

EST  OF 
VAR.  c a *■) 

(1-f) 

w2  VAR  CAL  w*p 

DDRE 

125 

5 

1  0.2000 

0.0623 

0.0400 

0.9600 

0.0039  0.000149  0.012469 

DDRU 

377 

6 

2  0.3333 

0.1880 

0.0444 

0.9841 

0.0354  0.001546  0.062677 

DDCO 

55 

8 

2  0.2500 

0.0274 

0.0268 

0.8545 

0.0008  0.000017  0.006858 

DDMT 

466 

11 

2  0.1818 

0.2324 

0.0149 

0.9764 

0.0540  0.000785  0.042258 

DDRV 

594 

10 

2  0.2000 

0.2963 

0.0178 

0.9832 

0.0878  0.001534  0.059252 

DDOU 

388 

5 

1  0.2000 

0.1935 

0.0400 

0.9871 

0.0374  0.001479  0.038703 

2005 

45 

10 

1.0000 

0.005510  0.222216 

SAHPLE  EST  OF  VAR: 

0.0055 

DISTRIBUTION  OF  SAMPLES 

STANDARD  ERROR: 

0.0742 

— 

SAMPLE  AVE 

: 

0.2222 

DDRE 

6 

DDRU 

19 

MINIMUM  SAMPLE  SIZE 

DDCO 

3 

- 

DDMT 

23 

PREC  LEVL 

0.08 

DDRV 

29 

COHF  LEVE 

1.96 

DDOU 

19 

N': 

104 

— 

n: 

99 

99 

F-5 


TABLE  F-9 


STRATIFIED  SAMPLING  PLAN:  CORE 


SAMPLE 


DCHC 

STRATUM 

NUMBER 

SAMPLE 

SIZE 

HUHBER 

NON-CONF 

PROPORT. 

<P) 

UEIGHT 

(W) 

EST  OF 
VAR.  (a1) 

(1-f) 

w2  VAR  CAL  w*p 

LOCAL 

778 

10 

3 

0.3000 

0.4707 

0.0233 

0.9871 

0.2215  0.005102  0.141198 

CENTRAL 

103 

8 

2 

0.2500 

0.0623 

0.0268 

0.9223 

0.0039  0.000096  0.015578 

NORTHEAST 

202 

8 

1 

0.1250 

0.1222 

0.0156 

0.9604 

0.0149  C. 000224  0.015275 

MID-ATLAN 

355 

6 

1 

0.1667 

0.2148 

0.0278 

0.9831 

0.0461  0.001260  0.035794 

SOUTH 

90 

5 

1 

0.2000 

0.0544 

0.0400 

0.9444 

0.0030  0.000112  0.010889 

WEST 

125 

5 

0 

0.0000 

0.0756 

0.0000 

0.9600 

0.0057  0.000000  0 

1653 

42 

8 

1.0000 

0.006794  0.218734 

SAMPLE  EST  OF  VAR:  0.0068 
STANDARD  ERROR:  0.0824 
SAMPLE  AVE:  0.2187 

MINIMUM  SAMPLE  SIZE 


PREC  LEVL  0.08 

CONF  LEVE  1.96 

N':  103 

n:  97 


DISTRIBUTION  OF  SAMPLES 


LOCAL 

46 

CENTRAL 

6 

NORTHEAST 

12 

MID-ATLAN 

21 

SOUTH 

5 

WEST 

7 

97 

TABLE  F-10 

STRATIFIED  SAMPLING  PLAN:  DDRW 
SAMPLE 


DCHC 

STRATUM 

NUMBER 

SAMPLE 

SIZE 

NUMBER 

NON-CONF 

PROPORT. 

CP) 

WEIGHT 

<w) 

EST  OF 
VAR.  (ff1) 

(1-f) 

u2  VAR  CAL  w*p 

LOCAL 

1821 

10 

3 

0.3000 

0.4319 

0.0233 

0.9945 

0.1866  0.004329  0.129578 

CENTRAL 

277 

8 

2 

0.2500 

0.0657 

0.0268 

0.9711 

0.0043  0.000112  0.016426 

NORTHEAST 

513 

8 

1 

0.1250 

0.1217 

0.0156 

0.9844 

0.0148  0.000228  0.01521 

MID-ATLAN 

857 

6 

« 

0.1667 

0.2033 

0.0273 

0.9930 

0.0413  0.001140  0.033879 

SOUTH 

371 

5 

1 

0.2000 

0.0880 

0.0400 

0.9865 

0.0077  0.000306  0.0176 

WEST 

377 

5 

1 

0.2000 

0.0894 

0.0400 

0.9867 

0.0080  0.000316  0.017884 

4216 

42 

9 

1.0000 

0.006430  0.230576 

SAMPLE  EST  OF  VAR:  0.0064 
STANDARD  ERROR:  0.0802 
SAMPLE  AVE:  0.2306 

MINIMUM  SAMPLE  SIZE 


PREC  LEVL  0.08 

CONF  LEVE  1.96 

N':  106 

n:  103 


DISTRIBUTION  OF  SAMPLES 


LOCAL 

46 

CENTRAL 

7 

NORTHEAST 

13 

MID-ATLAN 

21 

SOUTH 

9 

WEST 

9 

103 

F-6 


TABLE  F-11 


STRATIFIED  SAMPLING  PLAN:  CDCO 
SAMPLE 


STRATUM 

SAMPLE 

NUMBER  PROPORT. 

WEIGHT 

EST  OF 

DCMC 

NUMBER 

SIZE 

NCN-CONF  (p) 

CW> 

VAR.  (cl) 

(1-f) 

w2  VAR  CAL  w*p 

LOCAL 

308 

10 

3  0.3000 

0.3798 

0.0233 

0.9675 

0.1442  0.003256  0.113933 

CENTRAL 

109 

8 

2  0.2500 

0.1344 

0.0268 

0.9266 

0.0181  0.000448  0.0336 

NORTHEAST 

67 

8 

1  0.1250 

0.0826 

0.0156 

0.8806 

0.0068  0.000094  0.010327 

MID-ATLAN 

166 

6 

2  0.3333 

0.2047 

0.0444 

0.9639 

0.0419  0.001795  0.068229 

SOUTH 

106 

5 

1  0.2000 

0.1207 

0.0400 

0.9528 

0.0171  0.000651  0.026141 

WEST 

55 

5 

1  0.2000 

0.0678 

0.0400 

0.9091 

0.0046  0.000167  0.013564 

811 

42 

10 

1.000Q 

0.006411  0.265793 

SAMPLE  EST  OF  VAR: 

0.0064 

DISTRIBUTION  OF  SAMPLES 

STANDARD  ERROR: 

0.0501 

— 

SAMPLE  AVE 

: 

0.2658 

LOCAL 

39 

CENTRAL 

14 

MINIMUM  SAMPLE  SIZE 

NORTHEAST 

8 

- 

MID-ATLAN 

21 

PREC  LEVL 

0.08 

SOUTH 

13 

CONF  LEVE 

1.96 

WEST 

7 

N': 

117 

— 

n: 

102 

102 

TABLE  F- 12 

STRATIFIED  SAMPLING  PLAN:  DDMT 


SAMPLE 


DCMC 

STRATUM 

NUMBER 

SAMPLE 

SIZE 

HUMBER  PROPORT. 
NON-COMF  (p) 

WEIGHT 

fw) 

EST  OF 
VAR.  (crl) 

(1-f) 

u2  VAR  CAL  u*p 

LOCAL 

1722 

16 

3  0.1875 

0.3775 

0.0102 

0.9907 

0.1425  0.001434  0.070775 

CENTRAL 

296 

12 

2  0.1667 

0.0649 

0.0126 

0.9595 

0.0042  0.000051  0.010814 

NORTHEAST 

49? 

8 

1  0.1250 

0.1094 

0.0156 

0.9840 

0.0120  0.000184  0.013673 

MID-ATLAN 

1100 

11 

2  0.1818 

0.2411 

0.0149 

0.9900 

0.0581  0.000856  0.04384 

SOUTH 

479 

5 

1  0.2000 

0.1050 

0.0400 

0.9896 

0.0110  0.000436  0.021 

WEST 

466 

8 

1  0.1250 

0.1021 

0.0156 

0.9828 

0.0104  0.000160  0.012769 

4562 

60 

10 

1.0000 

0.003121  0.172870 

SAMPLE  EST  OF  VAR: 

0.0031 

DISTRIBUTION  OF  SAMPLES 

STANDARD  ERROR: 

0.0559 

— 

SAMPLE  AVE 

: 

0.1729 

LOCAL 

32 

CENTRAL 

5 

HINIHUH  SAMPLE  SIZE 

NORTHEAST 

9 

- 

MID-ATLAN 

20 

PREC  LEVL 

0.08 

SOUTH 

9 

CONF  LEVE 

1.96 

WEST 

9 

N': 

86 

— 

ns 

84 

84 

F-7 


TABLE  F- 13 


STRATIFIED  SAHPLING  PLAN:  DDRV 
SAMPLE 


DCMC 

STRATUM 

NUMBER 

SAMPLE 

SIZE 

NUMBER 

NON-CONF 

PROPORT. 

<P) 

WEIGHT 

(W) 

EST  OF 
VAR.  <crl) 

(1-f) 

w2  VAR  CAL  W*p 

LOCAL 

2359 

10 

3 

0.3000 

0.3744 

0.0233 

0.9958 

0.1402  0.003257  0.112316 

CENTRAL 

403 

8 

2 

0.2500 

0.0640 

0.0268 

0.9801 

0.0041  0.000107  0.01599 

NORTHEAST 

813 

8 

1 

0.1250 

0.1290 

0.0156 

0.9902 

0.0166  0.000258  0.016128 

MID-ATLAN 

1489 

6 

1 

0.1667 

0.2363 

0.0278 

0.9960 

0.0558  0.001545  0.039385 

SOUTH 

643 

5 

1 

0.2000 

0.1020 

0.0400 

0.9922 

0.0104  0.000413  0.020409 

WEST 

594 

5 

0 

0.0000 

0.0943 

0.0000 

0.9916 

0.0089  0.000000  0 

6301 

42 

8 

1.0000 

0.005580  0.204228 

SAMPLE  EST  OF  VAR:  0.0056 
STANDARD  ERROR:  0.0747 
SAMPLE  AVE:  0.2042 


MINIMUM  SAMPLE  SIZE 


PREC  LEVL 

0.08 

CONF  LEVE 

1.96 

N': 

98 

n: 

96 

DISTRIBUTION  OF  SAMPLES 


LOCAL 

36 

CENTRAL 

6 

NORTHEAST 

12 

MID-ATLAN 

23 

SOUTH 

10 

WEST 

9 

96 

TABLE  F-14 

STRATIFIED  SAMPLING  PLAN:  ODOU 
SAMPLE 


STRATUM 

SAMPLE 

NUMBER  PROPORT. 

WEIGHT 

EST  OF 

DCMC 

NUMBER 

SIZE 

NON-CONF  (p> 

(W) 

VAR.  (ffl> 

(1-f) 

u2  VAR  CAL  u*p 

LOCAL 

1430 

16 

3  0.1875 

0.3624 

0.0102 

0.9888 

0.1313  0.001319  0.067949 

CENTRAL 

280 

5 

2  0.4000 

0.0710 

0.0600 

0.9821 

0.0050  0.000297  0.028383 

NORTHEAST 

449 

8 

1  0.1250 

0.1138 

0.0156 

0.9822 

0.0129  0.000199  0.014223 

MID-ATLAN 

977 

11 

2  0.1818 

0.2476 

0.0149 

0.9887 

0.0613  0.000902  0.045017 

SOUTH 

422 

5 

1  0.2000 

0.1069 

0.0400 

0.9882 

0.0114  0.000452  0.021389 

WEST 

388 

9 

1  0.1111 

0.0983 

0.0123 

0.9768 

0.0097  0.000117  0.010925 

3946 

54 

10 

1.0000 

0.003285  0.187886 

SAMPLE  EST  OF  VAR: 

0.0033 

DISTRIBUTION  OF  SAMPLES 

STANDARD  ERROR: 

0.0573 

— 

SAMPLE  AVE 

: 

0.1879 

LOCAL 

33 

CENTRAL 

6 

HINIHUM  SAMPLE  SIZE 

NORTHEAST 

10 

- 

MID-ATLAN 

22 

PREC  LEVL 

0.08 

SOUTH 

10 

CONF  LEVE 

1.96 

WEST 

9 

N': 

92 

— 

n: 

90 

90 

F-8 


